Regret-based continuous-time dynamics
نویسندگان
چکیده
Regret-based dynamics have been introduced and studied in the context of discrete-time repeated play. Here we carry out the corresponding analysis in continuous time. We observe that, in contrast to (smooth) fictitious play or to evolutionary models, the appropriate state space for this analysis is the space of distributions on the product of the players’ pure action spaces (rather than the product of their mixed action spaces). We obtain relatively simple proofs for some results known in the discrete case (related to ‘no-regret’ and correlated equilibria), and also a new result on two-person potential games (for this result we also provide a discrete-time proof). 2003 Elsevier Inc. All rights reserved. JEL classification: C7; D7; C6
منابع مشابه
Dynamics in Games
The purpose of the course is to study several dynamics generated by strategic interactions in games. Among the topics are adaptive dynamics in evolutionary game theory, robust procedures for on-line algorithms and stochastic approximation. 1. Fictitious play Discrete time Continuous time and best reply dynamics 2. Replicator dynamics n populations One population Evolutionary Stable Strategies 3...
متن کاملOn the convergence of no-regret learning in selfish routing
We study the repeated, non-atomic routing game, in which selfish players make a sequence of routing decisions. We consider a model in which players use regret-minimizing algorithms as the learning mechanism, and study the resulting dynamics. We are concerned in particular with the convergence to the set of Nash equilibria of the routing game. No-regret learning algorithms are known to guarantee...
متن کاملNo-regret dynamics and fictitious play
Potential based no-regret dynamics are shown to be related to fictitious play. Roughly, these are ε-best reply dynamics where ε is the maximal regret, which vanishes with time. This allows for alternative and sometimes much shorter proofs of known results on convergence of no-regret dynamics to the set of Nash equilibria.
متن کاملContinuous and Global Stability in Innovative Evolutionary Dynamics
Innovation plays a central role in the development of modern economies, as does the regret of those who have missed the opportunity to try a successful new strategy. In contrast to purely biological environments, where new strategies emerge mainly by random mutation, human societies tend to exhibit more deliberate, although possibly imperfect inventions of new strategies. In this paper, we stud...
متن کاملA continuous-time approach to online optimization
We consider a family of learning strategies for online optimization problems that evolve in continuous time and we show that they lead to no regret. From a more traditional, discrete-time viewpoint, this continuous-time approach allows us to derive the no-regret properties of a large class of discretetime algorithms including as special cases the exponential weight algorithm, online mirror desc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Games and Economic Behavior
دوره 45 شماره
صفحات -
تاریخ انتشار 2003